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Abstract 

i-Q ■ 

In this paper we study one dimensional backward stochastic differential equations (BSDEs) 
with random terminal time not necessarily bounded or finite when the generator F(t, Y, Z) has 
a quadratic growth in Z . We provide existence and uniqueness of a bounded solution of such 
BSDEs and, in the case of infinite horizon, regular dependence on parameters. The obtained 
results are then applied to prove existence and uniqueness of a mild solution to elliptic partial 
' differential equations in Hilbert spaces. Finally we show an application to a control problem. 

<n : 

<N ■ 

1 Introduction 

o : 

\ Let r be a stopping time which is not necessarily bounded or finite. We look for a pair of 

processes (Y t ,Z t )t>o progressively measurable which satisfy Vi > 0,VT > t 



. — , / i-Tf\r i-TAt 

X ■ Y tAT = Y TAT + / F(s, Y s , Z 8 ) - / Z s dW K 



(1) 



Y T = £ on {r < oo} 



where W is a cylindrical Wiener process in some infinite dimensional Hilbert space H and 
the generator F has quadratic growth with respect to the variable z. Moreover the terminal 
condition £ is ^v-measurable and bounded. We limit ourselves to the case in which (Yt)t>o is 
one-dimensional and we look for a solution (Y t ,Z t )t>o such that {Yt)t>o is a bounded process 
and (Zt)t>o is a process with values in the space of the Hilbert-Schmidt operator from H to R 

such that E ( J * Ar \Z s \ 2 dsJ < oo, Vi > 0. 

BSDEs with random terminal time have been treated by several authors (see for instance [21], 
[6], [3], [23]) when the generator is Lipschitz, or monotone and with suitable growth with respect 
to y, but Lipschitz with respect to z. Kobylanski [18] deals with a real BSDE with quadratic 
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generator with respect to z and with random terminal time. She requires that the stopping time 
is bounded or P-a.s finite. We generalize in a certain sense the result of Kobylanski, but, to 
obtain the existence and uniqueness of the solution to (1) for a general stopping time, we have 
to require stronger assumption on the generator. In particular it has to be strictly monotone 
with respect to y. 

We follow the techniques introduced by Briand and Hu in [3], and used successively by 
Royer [23], based upon an approximation procedure and on Girsanov transform. We can use 
this strategy even if, under our assumptions, the generator is not Lipschitz with respect to 
z. The main idea is to exploit the theory of BMO-martingales. It is indeed known that if 

(Y, Z) solves a quadratic BSDE with bounded (or P-a.s.) finite final time then / Z s dW s is a 

Jo 

BMO-martingale (see [16]). 

Then the result on BSDE is exploited to study existence and uniqueness of a mild solution 
(see Section 5 for the definition) to the following elliptic partial differential equation in Hilbert 
space H 

Cu(x) +F(x,u(x), Vu(x)a) = 0, x G H, (2) 

where F is a function from H x R x E* to R strictly monotone with respect the second variable 
and with quadratic growth in the gradient of the solution and £ is the second order operator: 

C<f>(x) = ]^Trace{(j(j*V 2 (t>{x)) + (Ax,V(p(x)) + (b(x), V0(x)). 

H is an Hilbert space, A is the generator of a strongly continuous semigroup of bounded linear 
operators (e )t>o m H, b is a function with values in H and a belongs to L(S,iT)- the space 
of linear bounded operator from S to K satisfying appropriate Lipschitz conditions. 

Existence and uniqueness of a mild solution of equation (2) in infinite dimensional spaces 
have been recently studied by several authors employing different techniques (see [5], [14], [9] 
and [10]). 

In [13] (following several papers dealing with finite dimensional situations, see, for instance 
[4], [6] and [20]) the solution of equation (2) is represented using a Markovian forward-backward 
system of equations 

dX s = AX s ds + b(X s )ds + a(X s )dW s , s>0 

dY s = -F{X S , Y„ Z s )ds + Z s dW s , s>0 (3) 
X = x 

where F is Lipschitz with respect to y and z and monotone in y, but with monotonicity constant 
large. A such limitation has then been removed under certain conditions in [17], still assuming 
F Lipschitz with respect to z, strictly monotone and with arbitrary growth with respect to y. 
We follow the same approach to deal with mild solution to (2) when the coefficient F is strictly 
monotone in the second variable (there are not conditions on its monotonicity constant) and has 
quadratic growth in the gradient of the solution. The main technical point here will be proving 
differentiability of the bounded solution of the backward equation in system (3) with respect to 
the initial datum x of the forward equation. To obtain this result we follow [17]. The proof is 
based on an a-priori bound for suitable approximations of the equations for the gradient of Y 
with respect to x. We use again classical result on BMO-martingales. 

In the last part of the paper we apply the above result to an optimal control problem with 
state equation: 
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{ 



dX T = AX T dr + b(X T )dr + ar(X T , u T )dr + adW n 
X = x £ H, 



Tl 



(4) 



where u denotes the control process, taking values in a given closed subset U of a Banach space 
U. The control problem consists of minimizing an infinite horizon cost functional of the form 



We suppose that r is a function with values in E* with linear growth in u and g is a given real 
function with quadratic growth in u. A is any positive number. We assume that neither IA nor 
r is bounded: in this way the Hamiltonian corresponding to the control problem has quadratic 
growth in the gradient of the solution and consequently the associated BSDE has quadratic 
growth in the variable Z. The results obtained on equation (2) allows to prove that the value 
function of the above problem is the unique mild solution of the corresponding Hamilton-Jacobi- 
Bellman equation (that has the same structure as (2). Moreover the optimal control is expressed 
in terms of a feedback that involves the gradient of that same solution to the Hamilton-Jacobi- 
Bellman equation. We stress that the usual application of the Girsanov technique is not allowed 
(since the Novikov condition is not guaranteed) and we have to use specific arguments both to 
prove the fundamental relation and to solve the closed loop equation. We adapt some procedure 
used in [11] to our infinite dimensional framework on infinite horizon. 

The paper is organized as follows: the next Section is devoted to notations; in Section 3 
we deal with quadratic BSDEs with random terminal time; in Section 4 we study the forward 
backward system on infinite horizon; in Section 5 we show the result about the solution to PDE. 
The last Section is devoted to the application to the control problem. 

2 Notations 

The norm of an element x of a Banach space E will be denoted \x\e or simply \x\, if no confusion 
is possible. If F is another Banach space, L(E, F) denotes the space of bounded linear operators 
from E to F, endowed with the usual operator norm. 

The letters S, H, U will always denote Hilbert spaces. Scalar product is denoted (•, •), with 
a subscript to specify the space, if necessary. All Hilbert spaces are assumed to be real and 
separable. L2(E,C7) is the space of Hilbert-Schmidt operators from S to U, endowed with the 
Hilbert-Schmidt norm, that makes it a separable Hilbert space. We observe that if U = R the 
space L2(E, R) is the space L(S, R) of bounded linear operators from S to R. By the Riesz 
isometry the dual space E* = L(S, R) can be identified with E. 

By a cylindrical Wiener process with values in a Hilbert space E, defined on a probability 
space (fi, T, P), we mean a family {Wt, t > 0} of linear mappings from E to L 2 (VL), denoted 
£ i-> (£, W t ), such that 

(i) for every £ € E, {(£, Wt), t > 0} is a real (continuous) Wiener process; 



(J~t)t>o will denote, the natural filtration of W, augmented with the family of P-null sets. 
The filtration (Tt) satisfies the usual conditions. All the concepts of measurably for stochastic 




(ii) for every £1, & € E and t > 0, E W t ) ■ (6, W t )) = (6, 6)3 «■ 
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processes refer to this filtration. By 13(A) we mean the Borel cr-algebra of any topological space 
A. 

We also recall notations and basic facts on a class of differentiable maps acting among Ba- 
nach spaces, particularly suitable for our purposes (we refer the reader to [12] for details and 
properties). We notice that the use of Gateaux differentiability in place of Frechet differentia- 
bility is particularly suitable when dealing with evaluation (Nemitskii) type mappings on spaces 
of summable functions. 

Let now X, Z, V denote Banach spaces. We say that a mapping F : X — > V belongs to 
the class Q l (X, V) if it is continuous, Gateaux differentiable on X, and its Gateaux derivative 
V-F : X — > L(X, V) is strongly continuous. 

The last requirement is equivalent to the fact that for every h G X the map VF(-)h : X — > V 
is continuous. Note that VF : X — > L(X, V) is not continuous in general if L(X, V) is endowed 
with the norm operator topology; clearly, if this happens then F is Frechet differentiable on 
X. It can be proved that if F € Q 1 (X,V) then (x,h) t— > VF(x)h is continuous from X x X 
to V; if, in addition, G is in Q l (V,Z) then G(F) belongs to Q l (X,Z) and the chain rule holds: 
V(G(F))(x) = VG(F(x))VF(x). 

When F depends on additional arguments, the previous definitions and properties have 
obvious generalizations. 

3 Quadratic BSDEs with random terminal time 

Let r be an J^-stopping time. It is not necessarily bounded or P-a.s. finite. We work with a 
function F defined on VL x [0, oo) x R x E* which takes its values in R and such that F(-, y, z) 
is a progressively measurable process for each (y,z) in R x H*. We define the following sets of 
^-progressively measurable processes (tpt)t>o with values in a Hilbert space K: 

<2,-2A/ n ,. ts\ J „/. . nr / / „-2As 



M 2 1oc {0,t-K) = iV> s | 2 *^<oo Vt>0 

We want to construct an adapted process (Y, Z) t >o which solves the BSDE 

- dY t = l t < T (F(t, Y t , Z t )dt - Z t dW t ), Y T = i on {r < oo}. (5) 

We assume that: 
Assumption Al. There exist C > and a <G (0, 1) such that 

1. \F(t,y,z)\ <C(l + \y\ + \z\ 2 ); 

2. F(t,-,-) is ^ ljl (R x L 2 (S,R);R); 

3. \V z F(t,y,z)\<C(l + \z\); 

4. \V y F(t,y,z)\ <C(l + \z\) 2a . 

Moreover we suppose that there exist two constants K > and A > such that dF (g) dt 
a.e.: 
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5. F is monotone in y in the following sense: 

My, y' G R, z G £*, < y - y', F(t, y, z) - F(t, y', z) >< -X\y - y'| 2 ; 

6. \F(t, 0,0)\ < K; 

7. £ is a Jv-measurable bounded random variable; we denote by M some real such that 
|f | < M P-a.s. 

We call solution of the equation a pair of progressively measurable processes (Y t , Z t )t>o with 
values in R x H* such that 

1. Y is a bounded process and Z G ,M^ OC (0, r; £*); 

2. On the set {r < oo}, we have Y T = £ and ^ = for t > r; 

3. VT > 0, Vt G [0, T] we have 1W = F T Ar + £f ^(^ y ^ " ItlT Z * dW s- 

Before giving the main result of this section we prove a lemma which we use in the sequel. 
The proof involves the Girsanov transform and results of the bounded mean oscillation (BMO, 
for short) martingales theory. 

Here we recall a few well-known facts from this theory following the exposition in [15]. Let 
M be a continuous local (P, ^-martingale satisfying Mq = 0. Let 1 < p < oo. Then M is in the 
normed linear space BMOp if 



l|M|| 



BMO v 



sup 

T 



E[\M T -M T \ v \T T ^ lv 



< oo, 



where the supremum is taken over all stopping time r < T. By Corollary 2.1 in [15], M is a 
BMOp-martingale if and only if it is a BMOq-martingale for every q > 1. Therefore, it is simply 
called a BMO-martingale. In particular, M is a BMO-martingale if and only if 



\\M\\bmo 2 = sup E[(M) T - (M) T |JF T ] 1 / 2 



< oo, 



where the supremum is taken over all stopping time r < T; (M) denotes the quadratic variation 
of M. This means that local martingales of the form M t = £ s dW s are BMO-martingales if 
and only if 











1/2 


M\\bmo 2 = sup 


E 


J T \\Zs\\ 2 ds 






T 











< oo. 



The very important feature of BMO-martingales is the following (see Theorem 2.3 in [15]): 
the exponential martingale 



£{M) t =£ t = exp[M t --(M) t ) 0<t>T 



is a uniformly integrable martingale. 

Lemma 3.1. Let (U,V), be solutions to 

f-T 



U t = $+ [ l s <r [a s U s + b s V s + ip s ]ds - [ V s dW s 
Jt Jt 



(6) 



>t Jt 
where f is T T -measurable and bounded and a s ,b s , ip s are processes such that 
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1) a s < —A for some A > 0; 

2) J b s dW s is a BMO-martingale; 

3) \ip s \ < p( s ) where p is a deterministic function. 

Moreover we assume that U is bounded. Then we have P-a.s. for all t £ [0, T] 



Ut \ < e -KT-t) 



e- x ^ ds. 



Proof. Let (U, V) be a solution of the BSDE (6) such that U is bounded. 
We fix t € R + and set for s > t e s = e^Ar ardr . By Ito's formula we have, 



U t = e T £ + / ls<re s ^sds 



J e s V s (dW s 



Let Qt the probability measure on (fi, Tt) whose density with respect to P|^ T is 



£t = exp 



b,dW, 



\b s \ 2 ds 



By assumption J Q b s dW s is a BMO-martingale and the probability measures Qt and P^ are 
mutually absolutely continuous and Wt = Wt — Jq b r dr for < t < T is a Brownian motion 
under <Qt- 

Taking the conditional expectation with respect to Tt we get 



ex 



ds 



Ft 



and thanks to 3) 



\U t \ < (St)- 1 ^ U T e T \(i\ + J%(s)e s ds 



It a.s. 



But from 1) a s < —A and, for all s > t e s < e A ( s *) P-a.s., from which we get P-a.s. Vi G [0, T] 



\U t \ <e- x ^m\ OQ + £p(s)e- x ^ds. 



□ 



Corollary 3.2. Let (Y l ,Z % ), i = 1,2, be solutions to 



Yi = C+l l s < T F\s,Y^Zl)ds- I Z\dW s 



where £ l is T T -measurable and bounded. We assume that Y 1 and Y 2 are bounded and that the 
Z % are such that J Q Z l d dWt are BMO -martingales. Moreover F 1 is —X-monotone in the following 
sense: there exists A > such that 



Vy, y' G R, z € £*, <y- y', F\t, y, z) - F\t, y', z) >< -\\y - yf; 
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and verifies 

\F 1 (t,y,z)-F\t,y,z')\<C\z-z'\(l + \z\ + \z'\). 
We assume moreover that 

\F l {t,Y 2 ,Z 2 )-F 2 (t,Y 2 ,Z 2 )\<p(t) 
where p is a deterministic function. Then we have P-a.s. for all t G [0, T] 

\Y? - If | < e^"*)^ 1 - e 2 ||oo + J\{s)e-^ ds. 

Proof. Let (Y 1 , Z 1 ) and (Y 2 , Z 2 ) be solutions of the BSDE with data respectively (£\ F 1 ) and 
(£ 2 , F 2 ) such that Y 1 and Y 2 are bounded. We set Y = Y 1 - Y 2 and Z = Z 1 - Z 2 . It is enough 
to write the equation for the difference Y = Y 1 — Y 2 

alY t = -l t < T [F\t, Y t \ Z\) - F 2 (t, Y 2 , Z 2 )dt + Z t dW t ] 



as 



dY t = -l t < T [(a t Y t + btZ t + 4> t )dt + Z t dW t }. 
using a linearization procedure by setting 

F\s,Y},Zl)-F\s,YlZ^ 



a, = 



Ys 1 ~ Y 2 



-A 



, \iy}-y 2 + k 

otherwise 



and 



' F 1 (s, Y 2 , ZD - F\s, Y 2 _^]_ {z , _ ^ . f ! _ z , + Q 







\zi-z 2 \ 2 

^ s = F 1 (s,Y s 2 ,Z 2 )-F 2 (s,Y 2 ,Z 2 ) 



S 5/5 S S 

otherwise . 



□ 



Now we can state the main result of this section, concerning the existence and uniqueness 
of solutions of BSDE (5). 

Theorem 3.3. Under assumption Al there exists a unique solution (Y, Z) to BSDE (5) such 
that Y is a continuous and bounded process and Z belongs to M 2 OC (0, r; £*). 

Proof. Existence. We adopt the same strategy as in [3] and [23], with some significant modi- 
fications. 



Denote by (Y n , Z n ) the unique solution to the BSDE 

/•n rn 

Y t n = £lr<n + / 1s<tF(8, Y s n , Z n s )ds - \ Z\ 
Jt Jt 



s dW s , 



0<t<n. 



(7) 



We know from results of [18] that under Al-1,2,3,4 the BSDE (7) has a unique bounded 
solution and that 



sup ie[ o, TAn] \Y t \ n < (||e||oo + Cn)e t 
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and there exists a constant C = C n , which depends on 



su Pte[0,rAn] 1^71 



, such that 



<c„ 



bmo 2 



Now we study the convergence of the sequence of processes (Y n , Z n ). 

(i) First of all we prove that, thanks to the assumptions of boundedness and monotonicity 
Al-5,6, Y n is a process bounded by a constant independent on n. Applying the Corollary 3.2 
we have that P-a.s. Vn € N, Mt € [0, n] 



e- x ^\F(s,0,0)\ds<M + j. 



Moreover we can show that for each e > 



supE( / e- £S \Z™\ 2 ds) < 00. 

n>l Jo 



(8) 



(9) 



To obtain this estimate we take the function <p(x) = (e 2Cx — 2Cx — l) /(2C 2 ) which has the 
following properties: 

ip'(x) > if x > 0, 
-<p"{x) - Cip'(x) = 1. 

Thanks to (8) we can say that there exist a constant Kq such that Vs G [0, T], YJ 1 + Kq > 0, 
P-a.s. Now, if we calculate the Ito differential of e~ et ip(Y t n + Kq), using the previous properties, 
we have (9). 

(ii) Now we prove that the sequence (Y t n ) n >o converges almost surely. We are going to show 
that it is an almost definite Cauchy sequence. 

We define Y n and Z n on the whole time axis by setting 

Y t n = £lr<n, Z? = 0, if t > n. 



Fix t < n < m and set Y = Y m - Y n , Z = Z m - Z n and F(s,y,z) = l s <„F(s, y, z). We 
get, from Ito's formula 



Y t = Y rn + l s < T (F(s,Y s m ,Z™)-F(s,Y s n ,ZZ))ds- % 
Jt Jt 



dW s 



We note that 



\F(8,Y a n ,2%)-F( a ,Y a n ,2%))\ = \l s>n F(s,£l T < n ,0)\ < C(l + M)l s>n . 

Hence, we can apply the Corollary 3.2 with £ x = £l T < m and £ 2 = £l T < n , F 1 = F and F 2 = F, 
p(t) = C(l + M)l s > n and state that Vn, m € N, with n < m and Vt G [0, n], P-a.s. 

i-m 

\Y t m - Y t n \ < e- A ( m ^||eir< m - ar<n||oo + J C(l + M)e' X ^ ds < 

C(l + M) \ x(n _ t) 



<\M + 



A 



• (10) 
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The previous inequality implies that for each t > the sequence of random variable Y™ is a 
Cauchy sequence in L°°{Q), hence converges to a limit, which we denote Y t . If m goes to infinity 
in the last inequality, it comes that P-a.s., VO < t < n 



\Y t n -Y t \ < /3e _A ( n -*\ where f3 = M + 



C(l + M) 
A ' 



(11) 



This inequality implies that the sequence of continuous processes (Y n ) ne jsi converges almost 
surely to Y uniformly with respect to t on compact sets. The limit process Y is also continuous 
and from (8) we have that Vi G R+ \Y t \ < M + f . 

(hi) We show that the sequence (Y n ) n also converges in the space .M 2 '~ 2A (0, r; R). Indeed 
we have 



E 



e~ 2Xt \Y t n -Y t \ z dt 



o 



= E 


[/ 




Jo 



rnAr 1 r n 

/ e- 2Xt \Y t n -Y t \ 2 dt +E / e - 2Xt \Y t n -Y t \ z dt 

JO J UnAr 



and using the inequality (11) for the first term, we get that 

(•n/\T 



E 



/' 

Jo 



,-2XU Y n _y t \ 2 dt 



< (3 A ne 



In addition, from the definition of Y t n on R + , we know that Vt > n Y t n = £l r < n . Hence, 



E 



-2\t\\rn 



Y, n -Y t \ 2 dt 



nAr 



E 



I//-- - / e 2A< |lt — £l n<T \ 2 dt 

2 



< 



< 4E 



L n<r 



M + 



)/; 



-2Xt 



dt 



< 



», K 

T 1 ! 



-2 An 



Finally we have 



E 



e -2At|yn _ Yt fdt 



< e 



-2 An 



n/?^ + t ( ^ + "T 



A 



A 



Hence (Y ra ) converges to Y in .M 2, 2A (0, r;R). 

(iv) To continue, we show that the sequence (Z n ) n is a Cauchy sequence in the space 
- 2 ( A + e )(o, T ;S*). 

Fixi < n < m and set, as before, Y = Y m -Y n , Z = Z m -Z n and F(s, y, z) = l s < n F(s, y, z). 
We write 



where 



F(s, Y™, ZD - F(s, Y s n , Z n s ) = a^ m Y s + b? m Z s + l s>n F(s, £l T < n , 0) 
F(8,Y a m ,Z?)-F{ 8 ,Y 9 n ,Z? 



Vm Vn 

± s * s 



-A 



rn,m _ I 



(F( s,Y s n ,Z?)-F(s,Y?,Z?) 
\2t m Z n \ 2 



-, ifY^-Yp^O 
otherwise 

(Z?-Z»), i£Z?-Z??0 
otherwise . 
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From Ito's formula we get 

prAm prAm 

\Y \ 2 + / e- 2{x+ ^ s \Z s \ 2 ds+ / 2e- 2( - x+€ >Y s Z s dW s = 
Jo Jo 

prAm 



prAm 

= e- 2( - x+ ^ TAm \Y rAm \ 2 + / e- 2 ( A+£ ) s 2(A + e)\Y s \ 2 ds+ 

Jo 

prAm prAm 

+ / 2e- 2(x+e >Y s [a n / n Y s + b n ^ m Z s \ds+ / 2 e - 2 ( x+e >Y s F(s, £lr<n, 0)ds 

Jo JrAn 

and taking the expectation we have 

prAm prAm 

E e~ 2{x+e)s \Z s \ 2 ds <Ee- 2 ( A+e ) rAm |y rAm | 2 +E / e- 2 ^ s 2e\Y s \ 2 ds+ 

Jo Jo 

fiAm fiAm 

+ E / 2e- 2( - x+€)s Y s b^ m Z s ds + E / 2e- 2( - x+e)s Y s F(s, £lr<n, 0)ds. 

Jo JrAn 

Using the fact that 

2e' 2{x+e)s Y s b n s ' m Z s < 2|y s | 2 e- 2 ( A+e ) s |6"' m | 2 + ^e~ 2{x+ ^ s \Z s \ 2 

we get 

prAm prAm 

E / e~ 2{x+e)s \Z s \ 2 ds < 2Ee- 2 ( A+e ) rAm |y rAm | 2 + 2E / e~ 2( - x+€ >2e\Y s \ 2 ds+ 
Jo Jo 

prAm prAm 

+ 4E / \Y s \ 2 e' 2( - x+ ^ s \bf m \ 2 ds + E 4e- 2{x+e)s \Y s \\F(s,Zl T < n ,0)\ds < 

Jo JrAn 

(prAm prAm \ 

1 + 4 J e- 2es \b^ m \ 2 ds + 4C(1 + M)E J e- 2Xs \Y s \) . 

We note that 

| b n,m|2 <C(1 + \Z™\ 2 + \Z T s n \ 2 ) 

and by (9) sup n>1 E JJ" e~ 2es \Z™\ 2 ds < oo. Finally we obtain 

prAm 

E e^ x+t)s \Z s \ 2 ds < (3'{l + n)e~ 2Xn 

Jo 



where f3' depends on M, A, K. Moreover we have that 

e( T e- 2 ^ s \Z s \ 2 ds \ -() 

\J mAr 



hence 

E 



^ e~ 2 ^ s \Z s \ 2 ds} < (3' {I + n)e~ 2Xn . 



Hence (Z n ) is a Cauchy sequence in M 2, 2 ( A+e )(0, r; £*) and converges to the process Z in this 
space. 

(v) It remains to show that the process (Y, Z) satisfies the BSDE (5). 

We already know that Y is continuous and bounded and Z belongs to M 2 ~ 2( - x+t \0, r; £*). 
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By definition Vn £ N, VT, t such that < f < T < n we have 

,-TAt ,-TAt 

Y t n AT ~ Y? AT = / F(s, Y/\ 7%) - / Zy\V s . (12) 

JtAT J tAT 

Fix t and T. We shall pass to the limit in L 1 in the previous equality. The sequence Y t " T 
converges almost surely to Yt and is bounded by M + j uniformly in n. From Lebesgue's 
theorem we get that the sequence converges to Y tAT in L 1 . Moreover, J tA ^. T Z™dW s converges in 
to J^ T Z s dW s in L 2 since 

(■TAr ,-TAt \ 2 [-TAt 



E 



/ pTAt i-TAt \ * pTAt 

( Zy\V s - Z s dW s ) <e 2 ^ T E e~ 2 ^ s \Z r : - Z s \ 2 ds. 

\JtAT J tAT J JO 



We can note that J^ T F(s,YJ l , Zg)ds converges to F(s,Y s , Z s )ds in L 1 . Indeed 



E 



pTAt pTAt pT 

/ F(s,Y s n ,Z™)ds- F(s,Y s ,Z s )ds <E/ \F(s,Y s n , Z™)ds - F(s,Y s , Z s )\ds 

JtAT J tAT JO 



and, by the growth assumption on F, the map (Y, Z) — > F(-,Y,Z) is continuous from the 
space L^jL^O^jR)) x L 2 (S7; L 2 ([0, T];E*) to L 1 ^; L 1 ([0, T]; R)). (By classical result on 
continuity of evaluation operators, see e.g. [1]). Hence, passing to the limit in the equation (12), 
we obtain Vt, T such that t < T 



,-TAt ,-TAt 

YtAT - Y TAT = / F(s, Y s , Z s ) - / Z s dW s . 

JtAT JtAT 

So to conclude the proof, it only remains to check the terminal condition. Let u G {r < oo}, 
and n € N such that n > t(ui). Then 

\Y T ~ £l t <2n|M = \Y nAT - ei t <2n|H < |*W " ^AYIM + |Y„ 2 " T - £l t <2n|M < 

< /3e A ^)( W )e- 2An + \YH T - a*<2n|H < /3e- Am 

since 1^™ T = Y^™ = Y 2 ™ = £lt<2n Then, Y r = £ P-a.s. on the set {r < oo}, and the process 
(Y, Z) is solution for BSDE (5). 

Uniqueness. 

Suppose that (Y 1 , Z 1 ) and (Y 2 , Z 2 ) are both solutions of the BSDE (5) such that Y 1 and Y 2 
are continuous and bounded and Z l and Z 2 belong to Mf oc (0, r; £*). It follows directly from 
the Corollary 3.2 that Vt > 

Y t x - Y t 2 = P-a.s. 

and then, by continuity, Y 1 = Y 2 . 

Applying Ito's formula we have that dP <g> dt-a.e. Z\ = Z 2 . 

□ 



4 The forward-backward system on infinite horizon 

In this Section we use the previous result to study a forward-backward system on infinite horizon, 
when the backward equation has quadratic generator. 

We introduce now some classes of stochastic processes with values in a Hilbert space K which 
we use in the sequel. 
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• L p (17; L 2 (0, s; K)) defined for s G]0, +oo] and p G [1, oo), denotes the space of equivalence 
classes of progressively measurable processes ip : Q x [0, s[— ► K, such that 

/ rs \p/2 

Elements of L P (Q; L 2 (0, s; K)) are identified up to modification. 

• L p (17; C(0, s; K)), defined for s g]0, +oo[ and p G [1, oof, denotes the space of progressively 
measurable processes {Y>t, t G [0, s]} with continuous paths in K, such that the norm 

\^\ P LP(n;C([0,s];K))= E SU P W£ 
re[0,s] 

is finite. Elements of L p (Q;C(0,s;K)) are identified up to indistinguishability. 

• L 2 oc (Q; L 2 (0,oo; K)) denotes the space of equivalence classes of progressively measurable 
processes ip : Q x [0, oo) — > i<" such that 

Vt > E / |Vv| 2 cfr < oo. 
■/ o 

Now we consider the ltd stochastic equation for an unknown process {X s , s > 0} with values 
in a Hilbert space if: 

X s = e sA x + /"* e( s - r ) A 6(X r )dr + / S e (s " r)A adW r , s > 0. (13) 
Jo Jo 

Our assumptions will be the following: 

Assumption A2. (i) The operator A is the generator of a strongly continuous semigroup e tA , 
t > 0, in a Hilbert space if. We denote by m and a two constants such that |e* A | < me at for 
4 > 0. 

(ii) b : H —> H satisfies, for some constant L > 0, 

|6(x) -b{y)\ < L\x-y\, x,y G if. 
(hi) (j belongs to L(S,ff) such that e*^<r G L2(S, if) for every i > 0, and 

for some constants L > and 7 G [0, 1/2). 

(iv) We have &(■) G G l {H,H). 

(v) Operators ^4 + 6 x (x) are dissipative (that is (Ay,y) + (b x (x)y,y) < for all a; G if and 
y€D(A)). 

Remark 4.1. We note we need of assumptions (iv) — (w) to obtain a result of regularity of the 
process X with respect to initial condition x. 

We start by recalling a well known result on solvability of equation (13) on a bounded 
interval, see e.g. [12]. 
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Proposition 4.2. Under the assumption A2, for every p G [2, oo) and T > there exists a 
unique process X x G L p (Q;C(0,T; H)) solution of (13). Moreover, for all fixed T > 0, the map 
x — > I 1 is continuous from H to L P (S7; C(0, T; #)). 

E sup |X r | p < C(l + |x|) p , 

re[0,T] 

/or some constant C depending only on q, 7, T, L, a and m. 

We need to state a regularity result on the process X. The proof of the following lemma can 
be found in [17]. 

Lemma 4.3. Under Assumptions A2 the map x — > is Gateaux differentiate (that is belongs 
to Q(H, L p (Q,C(0,T; H))). Moreover denoting by V X X X the partial Gateaux derivative, then 
for every direction h G H, the directional derivative process V x X x h,t G R, solves, F — a.s., the 
equation 

V x Xfh = e tA h+ [ e aA V x F(X x )V x X x hda, t G R + . 
Jo 

Finally, F-a.s., \V x Xfh\ < \h\, for all t > 0. 
The associated BSDE is: 

Y t x =Yf+[ F(X X , Y x , Z x )da - [ Z x dW a , < t < T < 00. (14) 
Jt Jt 

Here X x is the unique mild solution to (13) starting from Xq = x. Y is real valued and Z takes 
values in £*, F : H x R x H* — > R is a given measurable function. 

We assume the following on F: 

Assumption A3. There exist C > and a G (0, 1) such that 

1. \F(x,y,z)\<C(l + \y\ + \z\ 2 ); 

2. isgW(ffxRxH*;R) ; 

3. |V x F(x,y,z)| < C; 

4. |V 2 F(x,y,z)| <C(l + |z|); 

5. |V„F(x,y,z)| <C(l + |z|) 2Q . 

6. A > and F is monotone in y in the following sense: 

x £ H,y,y' K,z £E* <y- y' , F(x, y, z) - F(x, y' , z) >< -\\y - y'\ 2 . 



Applying Theorem 3.3, we obtain: 
Proposition 4.4. Let us suppose that Assumptions A2 and A3 hold. Then we have: 

(i) For any x G H, there exists a solution (Y X ,Z X ) to the BSDE (14) such that Y x is a contin- 
uous process bounded by K/X, and Z G L 2 oc (tl; L 2 (0, 00; £)) with E J °° e' 2( ^ x+e >\Z s \ 2 ds < 
00. The solution is unique in the class of processes (Y,Z) such that Y is continuous and 
bounded, and Z belongs to L^ oc (J7; L 2 (0, 00; E)). 
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(ii) For allT > and p > 1, the map x — > (y 11 1 j Q ^ , Z 31 1 ^ Q ^ ) is continuous from H to the space 
LP(n;C(0,T;R)) x LP(n;L 2 (0,T;E)). 

Proof. Statement (i) is an immediate consequences of Theorem 3.3. Let us prove (ii). Denoting 
by (Y n ' x , Z n ' x ) the unique solution of the following BSDE (with finite horizon): 



/n rn 
F(X X , Y?>*, 2Z>*)d* - J Z^dW a , 

then, from Theorem 3.3again, \Y™' X \ < -y and the following convergence rate holds: 



(15) 



K 



Y t n > x -Y t x \<-exp{-\(n-t)}. 



Now, if x' m ->iasm-> +oo then 



y- x 'm V x \ <^ W x 'm V n ' x 'm I _j_ \\rn,X \TX\ i \\r n -i x 'm \T n > x \ 
( rp 1 rp | \ | 1 rp I "~ ' J T \ '~ \ T ± 

< 2^exp{-A(n-T)} + |y^ -Y£' x \. 
A 



Moreover for fixed n, Yp' x ' m -> Yp' x in L p (ft, .Fy, P; R) for all p > 1, by Proposition 4.2 in [2] 
Thus Y x ' m -► in L p (ft, JF T , P; R). 

Now we can notice that (Y x \^ 0T y Z x \ ^ Q T ^ ) is the unique solution of the following BSDE (with 
finite horizon): 

Y t x = Yf + £ F(X X ,Y X ,Z X )- J Z x dW a , 
and the same holds for (Y x ' m | j Q T y Z x ' m | ^ r j). By similar argument as in [2] we have 



E 



sup \Y t x -Y Xm \ p 
te[o,T] 



lAl/p 



+ E 



r 



|Z? - Zf r 



p/2 



lAl/p 



< CE 



y?-y* 



p+i 



p+i 



+ E 



F( s ,x*,y s ,z s ) -F( s ,x^,y,z s ) dsj 



p+i 



and we can conclude that (Y x ™ | j Q T j , Z 3 ™ | ^ ^ ) — > (Y x | ^ ^ , Z 31 1 ^ T j ) in L p (0; C(0, T; R)) x 
L p (ft;L 2 (0,T; -)). □ 



We need to study the regularity of . More precisely, we would like to show that Y(f belongs 
to G l (H,R). 

We are now in position to prove the main result of this section. 

Theorem 4.5. Under Assumption the map x —> Y X belongs to ^(i^R). Moreover \Ytf\ + 
|V x y o z | < c, for a suitable constant c. 

Proof. Fix n > 1, let us consider the solution (Y n,x , Z n ' x ) of (15). Then, see [2], Proposition 
4.2, the map x -> (Y n ' x (■) , Z n ' x {■)) is Gateaux differentiable from H to L p {n, C(0,T;R)) x 



14 



LP(n;L 2 (0,T;E*)), Vp G (l,oo). Denoting by (V x Y n > x h,V x Z n > x h) the partial Gateaux deriva- 
tives with respect to x in the direction h G H, the processes {V x Y™ ,x h, V x Z? ,x h, t G [0, n]} 
solves the equation, P — a.s., 



V x Y t n ' x h 



V x F(X x ,Y^,Z^)V x X^hda 



V y F(X x ,Y^ x ,Z^ x )V x Y^ x hda 
V Z F(X X , Y?> x , Z^ x )V x Z^ x hda - J V x Z^ x hdW a . 



(16) 



it Jt 
We note that we can write the generator of the previous equation as 



setting 



=C + <u + b n a v 

C = V X F(X X , Y™ ,x , Z^ x )V x X^ x h 
a n a = V y F(X x , Y?> x , Z^ x ) K = V Z F(X X ,Y^ X , Z^ x ). 



By Assumption A3 and Lemma 4.3, we have that for all x,h G H the following holds P-a.s. 
for all n G N and all a G [0, n]: 

|CI= V x F(X x ,Y^ x ,Z^' x )V x X x h <C\h\, 



a™ = V y F(X x , Ya' x , Z^ x ) < -A < 0, 



\K\ 



V Z F(X X ,Y^ X ,Z^ X ) <C(1 + \2Z> X \). 



Therefore f Q Za ,x dW a is a BMO-martingale. Hence J Q b s dW s is also a BMO-martingale and 
by Lemma 3.1, we obtain: 

sup \V x Y t n ' x \ < C\h\, P-a.s.; 

te[0,n] 

and applying Ito's formula to e~ 2Xt \ V x Y^ ,x h\ 2 and arguing as in the proof of Theorem 3.3, points 
(iii) and (iv), tanks to the (9), we get: 



E 



POO 

/ e- 2X \\V x Y t n ' x h\ 2 + \V x Z?> x h\ 2 )dt < d\h\ 2 . 
Jo 



Fix x,h G H, there exists a subsequence of {(V x Y n ' x h, V x Z n ' x h, V x Y Q n ' x h) : n G N} which 
we still denote by itself, such that (V x Y n,x h, V x Z n ' x h) converges weakly to (U l {x, h), V 1 (x, h)) 
in A4 2 '" 2A (0, oo; R x £*) and V x Y Q n ' x h converges to £(x, h) G P. 

Now we write the equation (16) as follows: 



V x Y t n > x h = V x Y Q n > x h- f\ x F{X x ,Y^ x ,Z^ x )V x X x 

Jo 



hda 



(V y F(X x , Y™ ,x , Z^ x ))V x Y^ x hda 
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Jo 

-/ V z F(X x ,Y?' x ,Z:> x )V x ZS> x hda+ I V x Z^ x hdW a 
Jo Jo 



(17) 
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and define an other process Uf(x, h) by 

rt 
10 



U?(x,h) = £(x,h)- [ V x F(X x ,Y x ,Z x )V x X x hda 

Jo 

- f\v y F(X^Y^Z^)Ul{x,h)da (18) 
J o 

f V z F(X x ,Y x ,Z x )V a 1 (x,h)da + [ V}(x,h)dW a , 
o Jo 



where (Y x , Z x ) is the unique bounded solution to the backward equation (14), see Proposition 
4.4. Passing to the limit in the equation (17) it is easy to show that V x Y™ ,x h converges to 
Uf{x, h) weakly in L 1 ^) for all t > 0. 

Thus U?{x,h) = U?(x,h), P-a.s. for a.e. t G R+ and \U?(x,h)\ < C\h\. 

Now consider the following equation on infinite horizon 

U(t,x,h) = U(0,x,h)- f V x F(X*,YZ,Z*)V x X*hd° 

Jo 

- [ (V y F(X x ,Y x ,Z x ))U(t,x,h)da (19) 
Jo 

-f V z F(X x ,Y x ,Z x )V(a,x,h)da + [ V(a,x,h)dW a . 
Jo Jo 

We claim that this equation has a solution. 

For each n G N consider the finite horizon BSDE (with final condition equal to zero): 

U n (t,x,h) = j\ x F(X x ,Y x ,Z x )V x X x hda 

(V y F(X:,Y a x ,Z x ))U n (t,x,h)da 

rn rn 

+ V z F(X x ,Y x ,Z x )V n (a,x,h)da- V n (a,x,h)dW a , 
Jt Jt 

By the result in [2] we know that this equation has a unique solution (U n (-,x,h),V n (-,x,h)) £ 
L P (Q; C(0, n; R)) x L P (Q; L 2 (0, n; £*)). The generator of this equation can be rewrite as 

(f>t(u,v) =ip t + atu + b t v 

where A = V x F{Xf , Yf, Zf )V x Xf and \i> t \ < C\h\, a t = V y F(X%, Yf, Z%) < -A, b t = 
V Z F(X%, Y*, Z%) and \b t \ < C(l + \Zf\). On the interval [0, n] the process jjj Z x s dWs is a BMO- 
martingale. Hence, from the Lemma 3.1 it follows that P-a.s. Vn € N, Vt € [0,n] \U?\ < %\h\ 
and as in the proof of existence in the Theorem 3.3, we can conclude that 

1. for each t > U n (t, x, h) is a Cauchy sequence in L°°(Q) which converges to a process U 
and P-a.s., Vt G [0,n] 

|?7 n (t,x,/i) -?7(t,x,/i)| < ^|/i|e- A ( n -*); 

A 

2. y n (-,x,/i) is a Cauchy sequence in L 2 oc (Q; L 2 ([0, oo); £*); 
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3. The processes limit (U(-,x,h),V(-,x,h) satisfy the BSDE (19). 



Moreover still from Lemma 3.1 we get that the solution is unique. 

Coming back to equation (18), we have that (U 2 (x, h), V 1 (x, h)) is solution in R + of the 
equation (19). 

In particular we notice that U(0,x,h) = £(x,h) is the limit of V x Y Q n,x h (along the cho- 
sen subsequence). The uniqueness of the solution to (19) implies that in reality U(0,x,h) = 
lim n _ +00 V x Yq' x Ii along the original sequence. 

Now let x m — > x. 

\U(0,x,h) - U{0,x m ,h)\ < \U(0,x,h) - U n (0,x,h)\ + \U n {0,x,h) - U n (0,x m ,h)\ + (20) 

Of 

+\U n (0, x m , h) - U(0, x m , h)\ < — e~ Xn \h\ + \U n (0, x, h) - U n (0, x m , h)\, 

where we have used the (1). We now notice that V X F, V y F, V ' Z F are, by assumptions, con- 
tinuous and |V X F| < C, |V„F| < C(l + \Z\) 2a , \V Z F\ < (7(1 + \Z\) . Moreover the following 
statements on continuous dependence on x hold: 

maps x — > X x , x — > V x X x h are continuous from H — > L^,(Q;C(0,T;H)) (see [12] Proposition 
3.3); 

the map x — ► ^ X |[ 0T ] ^ s continuous from H to L^(Q; C(0, T; M)) (see Proposition 4.4 here); 
the map x — > ^ x |[ t] * s continuous from il to Lp(f2; L 2 (0, T; £)) (see Proposition 4.4 here ). 

We can therefore apply to (20) the continuity result of [12] Proposition 4.3 to obtain in 
particular that U n (0, x' m , h) — > U n (0,x,h) for all fixed n as m — > oo. And by (20) we can 
conclude that £/ (0, x^, h) —> U (0, x, /i) as m — > oo. 

Summarizing [7(0, x, /j) = lirrin^oo V x Y Q n ' x h exists, moreover it is clearly linear in h and 
verifies \U(0,x,h)\ < C\h\, finally it is continuous in x for every h fixed. 

Finally, for t > 0, 

\im-[Y x+th -Y X ] = lim- lim YY™< x+th _ Y?' x ] = lim lim f "v x Y^ x+6th hd9 

t\0t l ° J t\0t«-+oo' J t\0n^+oo J Q X 

= limj U(0,x + 6th)hd6 = U(0,x)h 
and the claim is proved. □ 

5 Mild Solution of the elliptic PDE 

Now we can proceed as in [13]. Let us consider the forward equation 

X s = e sA x + f e is -' r)A b{Xr)dr + f e^ A adW r , s > 0. 
Jo Jo 



(21) 



Assuming that Assumption A2 holds, we define in the usual way the transition semigroup 
{Pt)t>o, associated to the process X: 

P t [ ( />}(x)=E ( t>(X x ), xeH, 
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for every bounded measurable function : H — »• R. Formally, the generator £ of (Pt) is the 
operator 

Ccj){x) = ^ Trace (ctct*V 2 ^(x)) + {Ax + b(x),V<p(x)). 
In this section we address solvability of the non linear stationary Kolmogorov equation: 

Cv{x) + F(x,v(x),Vv(x)a) = 0, x e H, (22) 

when the coefficient F verifies Assumption A3. Note that, for x G H, Vv(x) belongs to H*, so 
that Vv(x) a is in S*. 

Definition 5.1. We say that a function u : H — > R is a mild solution of the non linear stationary 
Kolmogorov equation (22) if the following conditions hold: 

(i) v G Q 1 {H,'EL) and 3(7 > such that \v{x)\ < C, \V x v(x)h\ < C \h\, for all x,heH; 

(ii) the following equality holds, for every x G H and T > 0: 

v(x) = e- XT P T [v](x) + e- xt P t Vv(-) <r) + Au(-)] (x) di. (23) 

where A is the monotonicity constant in Assumption A3. 

Together with equation (21) we also consider the backward equation 

Y t - Y T + / = / F(A S , F s , Z s )c/s < t < T < oo (24) 

Jt Jt 

where F : H xUxE* —>~Ris the same occurring in the nonlinear stationary Kolmogorov equa- 
tion. Under the Assumptions A2, A3, Propositions 4.2-4.4 give a unique solution {Xf , Y t x , Zf }, 
for t > 0, of the forward-backward system (21)-(24). We can now state the following 

Theorem 5.2. Assume that Assumption A2, Assumption A3 and hold then equation (22) has 
a unique mild solution given by the formula 

v(x) = Y*. 

where {Xf,Y t x ,Zf,t > 0} is the solution of the forward-backward system (21)- (24)- Moreover 
the following holds: 

Yf = v(Xf), Zf = Vv(Xf)a. 

Proof. Let us recall that for s > 0, Yf is measurable with respect to ^jo, s ] an d Fs\ it follows 
that Yq is deterministic (see also [7]). Moreover, as a byproduct of Proposition 4.5, the function 
v defined by the formula v(x) = Yq has the regularity properties stated in Definition 5.1. The 
proof that the equality (23) holds true for v is identical to the proof of Theorem 6.1 in [13]. 

6 Application to optimal control 

We wish to apply the above results to perform the synthesis of the optimal control for a general 
nonlinear control system on an infinite time horizon. To be able to use non-smooth feedbacks 
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we settle the problem in the framework of weak control problems. Again we follow [13] with 
slight modifications. We report the argument for reader's convenience. 

As above by H, S we denote separable real Hilbert spaces and by U we denote a Banach 
space. 

For fixed xo G H an admissible control system (a.c.s) is given by (fi, J 7 , (J r t)t>o, {Wt, t > 
0}, u) where 

• (J7,jr,P) is a complete probability space and (Tt)t>Q is a filtration on it satisfying the 
usual conditions. 

• {Wt : t > 0} is a S-valued cylindrical Wiener process relatively to the filtration (jF t ) t > 
and the probability P. 

• it : Ox [0, oo[^ U is a predictable process (relatively to (F t )t>o) that satisfies the constraint: 
ut G U, P-a.s. for a.e. t > 0, where £Y is a fixed closed subset of J7. 

To each a.c.s. we associate the mild solution X G Llp(Q; C(0,T; H)) (for arbitrary T > and 
arbitrary r > 1) of the state equation: 

dX T = (AX T + b(X T ) + ar(X T ,u T )) dr + adW T , r > 0, , . 

X = x £ H, ^ ' 

and the cost: 

r+oo 

J{x,u)=E / e- u g{X u u t ) dt, (26) 
■/ o 

where g : H x U — > R. Our purpose is to minimize the functional J over all a.c.s. Notice the 
occurrence of the operator a in the control term: this special structure of the state equation is 
imposed by our techniques. 

We work under the following assumptions. 

Assumption A4. 1. The process W is a Wiener process in S, defined on a complete prob- 
ability space (Q, J 7 , P) with respect to a filtration {T t ) satisfying the usual conditions. 

2. A, b verify Assumption A2. 

3. a satisfies Assumption A2 (iii) with 7 = 0; 

4. The set U is a nonempty closed subset of U . 

5. The functions r: HxU^z., g:HxU^>Tl are Borel measurable and for all x G H, 
r(x, •) and g(x,-) are continuous functions from U to S and from U to R, respectively. 

6. There exists a constant C > such that for every x, x' G H , u G K it holds that 

|r(x, u) — r(x', < C(l + |u|)|ar — x'\, 

\r(x,u)\ <C(l + |u|), (27) 
< 5(x,«) < C(l + \u\ 2 ), (28) 

7. There exist R > and c > such that for every x £ H u £ U satisfying \u\ > R, 

g{x,u) > c\u\ 2 . (29) 
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We will say that an (J r t )-adapted stochastic process {ut,t > 0} with values in U is an 
admissible control if it satisfies 

E / e~ xt \u t \ 2 dt < oo. (30) 
Jo 

This square summability requirement is justified by (29): a control process which is not 
square summable would have infinite cost. 

Now we state that for every admissible control the solution to (25) exists. 

Proposition 6.1. Let u be an admissible control. Then there exists a unique, continuous, 
(Tt)- adapted process X satisfying Esup tg [ 0T ] \X t \ 2 < oo, and F-a.s., t G [0,T] 

X t = e tA x+ f e {t ' s)A b{X s )ds+ f e^ s)A adW s + f e^ A ar(X s ,u s )ds. 
Jo Jo Jo 

Proof. The proof is an immediate extension to the infinite dimensional case of the Proposition 
2.3 in [11]. □ 

By the previous Proposition and the arbitrariness of T in its statement, the solution is defined 
for every t > 0. We define in a classical way the Hamiltonian function relative to the above 
problem: for all x G H, zdS*, 

F(x, y, z) = mf{g(x, u) + zr(x, u) :u£U} - Xy 

T(x, y, z) = {u G U : g(x, u) + zr(x, u) — Xy = F(x, y, z)}. 

The proof of the following Lemma can be found in [11] Lemma 3.1. 

Lemma 6.2. The map F is a Borel measurable function from H x S* to R. There exists a 
constant C > such that 

-C{l + \z\ 2 ) - Xy < F(x,y,z) < g(x,u) + C\z\(l + \u\) - Xy Vn G U. (32) 

We require moreover that 
Assumption A5. F satisfies assumption A3 2-3-4. 

We notice that the cost functional is well defined and J(x, u) < oo for all x G H and all a.c.s. 
By Theorem 5.2, the stationary Hamilton- Jacobi-Bellman equation relative to the above 
stated problem, namely: 

Cv(x) +F(x,v(x),Vv(x)a) = 0, x G H, (33) 
admits a unique mild solution, in the sense of Definition 5.1. 

6.0.1 The fundamental relation 

Proposition 6.3. Let v be the solution of (33). For every admissible control u and for the 
corresponding trajectory X starting at x we have 

J(x, u) = v{x)+ 

E e ~ Xt ( ~ F{XU Vv{Xt)a) ~ Xv{Xt) + Vxv(X t )ar(X t , u t ) + g(X t ,u t fj dt. 
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Proof. We introduce the sequence of stopping times 

T n = inf{t G [0,T] : f \u s \ 2 ds > n}, 
Jo 

with the convention that r n = T if the indicated set is empty. By (30), for P-almost every uj G Q, 
there exists an integer N(u) depending on u such that 

n > N(u) t„(w) = T. (34) 

Let us fix no £if, and for every n, let us define 

< = u t l t < Tn + u l t>Tn 

and consider the equation 



dX? = b{X?)dt + a[dW t + r(X?,v$)dt], < t < T 



X " = x. 



Let us define 

ft 



(35) 



:= W t + / r(Xl l , u n s )ds 0<t<T. 
Jo 

From the definition of r n and from (27), it follows that 

fT fT fr„ 

/ \r{X™,u n s )\ 2 ds < C / (1 + |<|) 2 (is < C / (1 + \u s \) 2 ds + C < C + Cn. (36) 
JO ■/ o Jo 

Therefore defining 

Pn = exp -r(X?, u n s )dW s \r(X^u^)\ 2 ds\ 

the Novikov condition implies that Kp n = 1. Setting cflPJ = /9„cflP|_^ T , by the Girsanov theorem 
W n is a Wiener process under Pj,. Relatively to W n the equation (35) can be written: 

f dX t n = 6(X t n )dt + crdW/ 1 , < t < T 
\ Xq = x. 

Consider the following finite horizon Markovian forward-backward system (with respect to 
probability ¥ T and to the filtration generated by {VF™ : r G [0,T]}). 

X?(x) = e rA x + / T e (T " s)A 6(X s n (x)) + f e^ A a dW™, r > 0, 

^ f T f T Jo (38) 

Y?(x)-v(XZ(x))+ Z n s {x)dW^=\ F(X^x),Y s n (x),Z^x))ds,0<r<T, 
\ Jt Jt 



and let (X n (x), Y n (x), Z n (x)) be its unique solution with the three processes predictable rela- 
tively to the filtration generated by {W™ : r G [0,T]} and: EJsup tg[0T] |Xf(a;)| 2 < +oo, Y n (x) 

bounded and continuous, Ej, / \Z^(x)\ 2 dt < +oo. Moreover, Theorem 5.2 and uniqueness of 
the solution of system (38) , yields that 

Y?{x) = v(X?(x)), Z?{x) = Vv(X?(x))G(X?(x)). (39) 
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(40) 



Applying the Ito formula to e xt Yp(x), and restoring the original noise W we get 

f T ,-T 

e- Xr "Y?Jx) = e~ XT Yf(x) + / \e~ xt Y? \x)ds - / e~ Xs Z™(x) dW s 
+ f e- Xs [F(X-(x),Y s n (x),Z-(x)) - Z?(x)r(X?,u?)] ds. 

We note that for every p£ [1, oo) we have 

p-P = exp (p j\(X^u n s )dW™ |r(X s ",<)| 2 ^ 

ew ^p£ Hx n u n ){ 2 ds y (41) 

By (36) the second exponential is bounded by a constant depending on n and p, while the first 
one has P n -expectation, equal to 1. So we conclude that W l pn P < oo. It follows that 

/ ,T \ 1/2 / fT x 1/2 

E^ e- 2Xt \Zl l (x)\ 2 dtj <^ n [j Q Pn 2 \Zl\x)\ 2 dtj < 

/ f T xl/2 

< (E>- 2 ) 1/2En U \Zt{x)\ 2 dt\ <oo 

We conclude that the stochastic integral in (40) has zero expectation. Using the identification 
in (39) and taking expectation with respect to P, we obtain 

fT 

Ee -Ar„ y n = g-^E^X^))] + E / Xe'^Yj 1 (x)ds+ 

+E [ T e- Xs [F(X^x),Y s n (x),Z^(x)) - Z?(x)r(X?{x),u?)] ds < (42) 
<e' XT E[v{X'^{x)]+E \e- Xs Y s n (x)ds + E e - Xs g(X™{x), u n s )ds. 

Now we let n — > oo. By Proposition 4.4, 

su V \Y t n \ = sn V \v{Xl l )\<^-- (43) 
t>0 t>0 A 

in particular 

E f Xe- Xs Y s n (x)ds <E / Ae _As y<is < Eif(T — r n ) 
and the right-hand side tends to by (34). By the definition of u n and (28), 

E f T g{X^u n s )ds = E f T \ s>Tn g(X^u )ds< 

Jr n JO 

< CE f T l s>Tn (l + \u \ 2 )ds < CE(T - r n ) (44) 

J 
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and the right-hand side tends to again by (34). Next we note that, again by (34), for n > N(co) 
we have T n {uj) = T and v(X!f) = v(X?J = v(X Tn ) = v(X T ). We deduce, thanks to (43), that 
Ev(X%) -> Ev(X T ), and from (42) we conclude that 

limsupEe" Ar ™y^ < e~ XT Ev(X T ). 

n—*co 

On the other hand, for n > N(u>) we have T n {u) = T and e~ XTn Y£ = e~ XT Yfi = e~ XT v(X%) = 
e~ XT v(X T ). Since Y n is bounded, by the Fatou lemma, Ee~ XT v(X T ) < liminf^oo Ee~ Arn Y T ™ . 
We have thus proved that 

lim Ee _AT »y£ = e - XT Ev{X T ). (45) 
Now we return to backward equation in the system (38) and write 

„-Ar„yn V n _i_ 

e *r n - Y + 

+ / -e- xt F{X t a ,Y t n ,Zl l )dt+ / -Xe- xt Y i a dt+ / e~ xt Z?dW t + / e~ xt Z^r{X^ ,u?)dt 
Jo Jo Jo Jo 

Arguing as before, we conclude that the stochastic integral has zero P-expectation. Moreover, 
we have Y Q n = v(x), and, for t < r n , we also have uf = u t , X™ = X t , Y t n = v(X^) = v(X t ) and 
Zf = V x v(X t ). Thus, we obtain 



E[ e - A ^y«] = v{x)+ 

+ E / e- M ( - F(X t ,v(X t ), V x v(X t )a) - \v{X t ) + V x v(X t )ar(X t , u t ) ) dt (46) 



E / e- xt g(X t , u t )dt + E[ e - Xr "Y^} = v(x)+ 



and 

JO 

+ E jT" e- xt ( - F(X t , v(X t ),V x v(X t )a) - Xv(X t ) + V x v{X t )ar(X u u t ) + g(X t ,u t )\ dt. (47) 

Noting that —F(x, y, z) — \y + zr(x, u) + g(x, u) > and recalling that g(x, u) > by (45) and 
the monotone convergence theorem, we obtain for n — > oo, 

rT 



1 f e' xt g(X t , u t )dt + e' XT Ev{X T ) = v{x) + 
Jo 



E 

Jo 

+ E J e- xt ( - F(X t , V x v(X t )a) - Xv(X t ) + V x v(X t )ar(X t ,u t ) + g(X t ,u t )^ dt. (48) 

Recalling that v is bounded, letting T — > oo, we conclude 

J(x, u) = v{x)+ 

/•oo 

E / e- xt l-F(X t ,v(X t ), Vv(X t )a) - \v{X t ) + V x v(X t )ar(X t , u t ) + g{X u u t )} dt. 
Jo 

The above equality is known as the fundamental relation and immediately implies that v(x) < 
J(x, u) and that the equality holds if and only if the following feedback law holds P-a.s. for 
almost every t > 0: 

F(X t , v(X t ),V x v(X t )a) = V x v(X t )a + g(X t , u t ) - Xv(X t ) 

where X is the trajectory starting at x and corresponding to control u. □ 
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6.0.2 Existence of optimal controls: the closed loop equation. 

Next we address the problem of finding a weak solution to the so-called closed loop equation. 
We have to require the following 

Assumption A6. T(x, y, z), defined in 31, is non empty for all x € H and z € S*. 

By simple calculation (see [11] Lemma 3.1), we can prove that this infimum is attained in a 
ball of radius C(l + \z\), that is, 

Fix, y, z) = min u) + zrix, u)] — Xy, x £ H, y € R, z € E*, 

uew,|u|<c(i+|z|) 

and 

F(x,y,z) < g(x,u) + zr(x,u) - Xy if \u\ > C(l + \z\). (49) 

Moreover, by the Filippov Theorem (see, e.g., [1, Thm. 8.2.10, p. 316]) there exists a measurable 
selection of T, a Borel measurable function 7 : H x E* — > U such that 

F(x,y,z) = g(x,'y(x,z)) + zr(x,j(x, z)) - Xy, x G H, y € R, z £ E* . (50) 

By (49), we have 

\ 7 (x,z)\ <C(l + \z\). (51) 

We define 

u(x) = j(x,V x v(X t )a) F-a.s. for a.e t > 0. 
The closed loop equation is 



dX t = AX t dt + b(X t )dt + a[dWt + r(X t ,u(X t ))dt] t > 
X = x 



(52) 



By a weak solution we mean a complete probability space (fi, P) with a filtration {Tt) satisfy- 
ing the usual conditions, a Wiener process W in E with respect to P and (^t), and a continuous 
(^t)-adapted process Xwith values in H satisfying, P-a.s., 



POO 

/ e~ M \u(X t )\ 2 dt < 00 
JO 



and such that (52) holds. We note that by (27) it also follows that 

/ \r(X t ,u(X t ))\ 2 dt < 00, P-a.s., 
Jo 

so that (52) makes sense. 

Proposition 6.4. Assume that b,a,g satisfy Assumption A4, F verifies Assumption A5 and 
Assumption A6 holds. Then there exists a weak solution of the closed loop equation, satisfying 
in addition 

r-co 

E / e- xt \u{X t )\ 2 dt < 00. (53) 
Jo 
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Proof. We start by constructing a canonical version of a cylindrical Wiener process in S. An 
explicit construction is needed to clarify the application of an infinite-dimensional version of the 
Girsanov theorem that we use below. We choose a larger Hilbert space S D S in such a way 
that S is continuously and densely embedded in S with Hilbert-Schmidt inclusion operator J7\ 
By f2 we denote the space C([0, oo[, S ) of continuous functions lo : [0, oo[— > 5 endowed with 
the usual locally convex topology that makes Q a Polish space, and by B its Borel cr-field. Since 
J J* has finite trace on S , it is well known that there exists a probability P on B such that 
the canonical processes W t {oj) := Lo(t), t > 0, is a Wiener process with continuous paths in S 
satisfying E[(W t ', £'} H ' (W^, 77'}^] = (JJ*t',ri') E > (t A s) for all 7/ G S', t, s > 0. This is called 
a J r l 7*-Wiener processes in H in [8], to which we refer the reader for preliminary material on 
Wiener processes on Hilbert spaces. Let us denote by Q the P-completion of B and by N the 
family of sets A G Q with ¥(A) = 0. Let B t = a{W' s : s G [0, t}} and T t = a(B t ,J\f), t > 0, where 
as usual u(-) denotes the c-algebra in O generated by the indicated collection of sets or random 
variables. Thus (J r t)t>o is the Brownian filtration of W . 

The E-valued cylindrical Wiener process {W/ : t > 0, £ G H} can now be defined as follows. 
For £ in the image of J* J we take 77 such that £ = J*Jr] and define w| = (H 7 ^, c7??) H ' . Then 
we notice that Elw/l 2 = t\Jr]\'i, = £|£||, which shows that the mapping £ — > W|, defined for 
£ G J*J(E) C S with values in L 2 (Q, J 7 , P), is an isometry for the norms of E and L 2 (Q, J 7 , P). 
Consequently, noting that J*J(E) is dense in S, it extends to an isometry £ — > L 2 (w,.F, P), 
still denoted £ — > W/. An appropriate modification of {wj* : t > 0,£ G E} gives the required 
cylindrical Wiener process. We note that the Brownian filtration of W coincides with (^ r t)t>o- 

Now let X G £f oc (ft, C(0, +00; il)) be the mild solution of 

dX r = AX T dr + b(X T ) dr + a dW T 
Ao — X 

If together with previous forward equation we also consider the backward equation 

Y t - Y T + / = / F(A" S , F s , Z s )ds < t < T < 00 (55) 

we know that there exists a unique solution {Xf , Y^, Zf , i > 0} forward-backward system (54)- 
(55) and by Proposition 5.2, 

v(x) = Y *. 

is the solution of the of the non linear stationary Kolmogorov equation: 

Cv{x) + F(x,v{x),Vv(x)a) = 0, x G H. (56) 
Moreover the following holds: 

Y T (x) = v(X T (x)), Z T (x) = Vv{X T {x))a (57) 

We have 

roo 

E / e-( A+£ )*|Z t | 2 di < 00. (58) 
■/ 



'0 

and hence 



T 



E / \Z t \ 2 dt < 00. (59) 
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By (27) we have 

\r(X t ,u(X t ))\<C(l + \u(X t )\), (60) 

and by (51), 

\u(X t )\ = \ 1 (X t ,Vv(X t (x))a)\<C(l + \Vv(X t (x))a\) = C(l + \Z t \). (61) 
Let us define VT > 



M T = exp ^£(r(X s ,u(X s ),dW s )~ - \ \r(X s ,u(X s )\l ds 



(62) 



Now, arguing exactly as in the proof of Proposition 5.2 in [11], we can prove that EMj = 1, and 
M is a P-martingale. Hence there exists a probability Pt on Tt admitting Mr as a density with 
respect to P, and by the Girsanov Theorem we can conclude that {Wt,t 6 [0, T]} is a Wiener 
process with respect to P and {J~t)- Since S is a Polish space and Pt+a coincide with Py on 
£>T, T,h > 0, by known results (see [22], Chapter VIII, §1, Proposition (1.13)) there exists a 
probability P on B such that the restriction on Bt of Pt and that of P coincide, T > 0. Let 
Q be the P-completion of B and Ft be the P-completion of Bt- Moreover, since for all T > 0, 
{Wt : t £ [0,T]} is a H-valued cylindrical Wiener process under Pt and the restriction of Pt 
and of P coincide on Bt modifying {Wt : t > 0} in a suitable way on a P-null probability set we 
can conclude that (f2, £/, {Ft, i > 0},P, {Wt,t > 0}, j(X, Vv(X)a(X))) is an admissible control 
system. The above construction immediately ensures that, if we choose such an admissible 
control system, then (52) is satisfied. Indeed if we rewrite (54) in terms of {Wt : t > 0} we get 

dX T = AX T dr + b(X T ) dr + a [r(X T ,u(X T ))dT + dW T ] 
X = x. 

It remains to prove (53). We define stopping times 

o n = inf jt > : e - A *|Z s | z ds > n 

with the convention that (!„ = oo if the indicated set is empty. By (58) for P-a.s. oo € ft, there 
exists an integer N(u) depending on uj such that a n (uj) = oo for n > N(lo). Applying the Ito 
formula to e~ xt Y t , with respect to W , we obtain 



»-/ 

J 

+ / e- Xs [-F(X s ,Y s ,Z s ) - XY s (x)ds + Z s r(X s ,u(X s ))} ds. 
Jo 



e~ Aa "Y an =Y - I e' AS Z s dW s + 



from which we deduce that 



Ee~ Xa "Y an +E I " e- Xs g(X s ,u(X s ))ds = Y + 
Jo 

+E / e~ Xs [-F(X S , Y s , Z s ) - \Y s ds + Z s r(X s , u(X s )) + g(X s ,u(X s ))} ds = Y . 
Jo 

with the last equality coming from the definition of u. Recalling that Y is bounded, it follows 
that 



E e~ Xs g{X s ,u(X s ))ds <C 
Jo 



for some constant C independent of n. By (29) and by sending n to infinity, we finally prove 
(53). 

□ 



26 



References 



[1] A. Ambrosetti, G. Prodi. A primer of nonlinear analysis, Cambridge Studies in Advanced 
Mathematics, 34, Cambridge University Press, 1995. 

[2] Ph. Briand, F. Confortola. BSDEs with stochastic Lipschitz condition and quadratic PDEs 
in Hilbert spaces. Stochastic Processes and their Applications. To appear. 

[3] P. Briand, Y. Hu. Stability of BSDEs with random terminal time and homogenization of 
semilinear elliptic PDEs. J. Fund. Anal. 155 (1998), 455-494. 

[4] R. Buckdahn, S. Peng. Stationary backward stochastic differential equations and associated 
partial differential equations. Probab. Theory Related Fields 115 (1999), 383-399. 

[5] S. Cerrai, Second order PDE's in finite and infinite dimensions. A probabilistic approach. 
Lecture Notes in Mathematics 1762, Springer, Berlin, 2001. 

[6] R. W. R. Darling, E. Pardoux. Backwards SDE with random terminal time and applications 
to semilinear elliptic PDE, Ann. Probab. 25 (1997), 1135-1159. 

[7] N. El Karoui. Backward stochastic differential equations: a general introduction. In Back- 
ward stochastic differential equations (Paris, 1995-1996), volume 364 of Pitman Res. Notes 
Math. Ser., pages 7-26. Longman, Harlow, 1997. 

[8] G. Da Prato and J. Zabczyk. Stochastic Equations in Infinite Dimensions. Cambridge 
University Press, Cambridge, 1992 

[9] G. Da Prato and J. Zabczyk. Second Order Partial Differential Equations in Hilbert Spaces. 
Cambridge University Press, Cambridge, 2002. 

[10] F. Masiero. Infinite horizon stochastic optimal control problems with degenerate noise and 
elliptic equations in Hilbert spaces. Preprint, Politecnico di Milano, 2004 (submitted). 

[11] M. Fuhrman,Y. Hu and G. Tessitore. On a class of stochastic optimal control problems 
related to BSDEs with quadratic growth. SI AM J. Control Optim. 45 (2006), no. 4, 1279- 
1296. 

[12] M. Fuhrman and G. Tessitore. Nonlinear Kolmororov equations in infinite dimensional 
spaces: the backward stochastic differential equations approach and applications to optimal 
control. Ann. Probab. 30 (2002), 1397-1465. 

[13] M. Fuhrman and G. Tessitore, Infinite horizon backward stochastic differential equations 
and elliptic equations in Hilbert spaces. Ann. Probab. 30 (2004), 607-660. 

[14] F. Gozzi, E. Rouy. Regular solutions of second-order stationary Hamilton-Jacobi equations. 
J. Differential Equations 130 (1996), 201-234. 

[15] N. Kazamaki. Continuous exponential martingales and BMO, volume 1579 of Lecture Notes 
in Mathematics. Springer- Verlag, Berlin, 1994. 

[16] Y. Hu, P. Imkeller, and M. Miiller. Utility maximization in incomplete markets. Ann. Appl. 
Probab., 15(3):1691-1712, 2005. 



27 



[17] Y. Hu and G. Tessitore. BSDE on an infinite horizon and elliptic PDEs in infinite dimension. 
NoDEA Nonlinear Differential Equations Appl. To appear. 

[18] M. Kobylanski. Backward stochastic differential equations and partial differential equations 
with quadratic growth. Ann. Probab., 28(2):558-602, 2000. 

[19] J.-P. Lepeltier and J. San Martin. Existence for BSDE with superlinear-quadratic coeffi- 
cient. Stochastic Stochastics Rep., 63(3-4) :227-240, 1998. 

[20] E. Pardoux. Backward stochastic differential equations and viscosity solutions of systems of 
semilinear parabolic and elliptic PDEs of second order, in: Stochastic Analysis and related 
topics, the Geilo workshop 1996, eds. L. Decreusefond, J. Gjerde, B Gksendal, A.S. Ustiinel, 
79-127, Progress in Probability 42, Birkhauser, Boston, 1998. 

[21] E. Pardoux. BSDEs, weak convergence and homogenization of semilinear PDEs. Nonlinear 
analysis, differential equations and control (Montreal, QC, 1998), 503-549, NATO Sci. Ser. 
C Math. Phys. Sci., 528, Kluwer Acad. Publ., Dordrecht, 1999. 

[22] D. Revuz and M. Yor. Continuous martingales and Brownian motion. Grundlehren der 
Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences], 293. 
Springer- Verlag, Berlin, (1999). 

[23] M. Royer. BSDEs with a random terminal time driven by a monotone generator and their 
links with PDEs. Stochastics Stochastics Rep. 76 (2004) 281-307. 



28 



